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Abstract 


The Rio scale is a tool for communicating the significance of a signal to the general public. It 
assigns scores to signals detected in searches for extraterrestrial intelligence (SETI), which 
characterizes both the consequences of a signal and the probability the signal is truly from 
ETI, in an easily digestible format for laypeople to interpret. In the 17 years since its construc- 
tion, the number of groups actively conducting searches for evidence of intelligent life beyond 
the Earth has increased significantly, and theoretical work has established a new suite of 
observables that are capable of revealing the presence of ETI in a range of astronomical obser- 
vations. In this paper, we revise the Rio scale, with the aim of (i) achieving consensus across 
academic disciplines on a scheme for classifying signals potentially indicating the existence of 
advanced extraterrestrial life, (ii) supplying a pedagogical tool to help inform the public about 
the process scientists go through to develop an understanding of a signal and (iii) providing a 
means of calibrating the expectations of the world at large when signals are discussed in the 
media. We also present (and encourage the SETI community to adopt) a single set of consist- 
ent terminology for discussing signals. 


Introduction 


The discovery of extraterrestrial intelligence (ETI) (or its absence in rigorous, complete surveys 
of the local Universe) would clearly have enormous consequences for humanity. This has 
prompted scientists to conduct searches for ETI, or SETI, at least for the last 50 years or 
so. The lack of confirmed detections of ETI so far may be dismaying, but it remains an import- 
ant data point in our quest to place human beings in cosmic context. 

SETI searches vary widely in their methodology, targets and analysis. The ‘classic’ radio 
SETI method (Cocconi and Morrison, 1959) focuses on detecting either intentional or unin- 
tentional radio transmissions from ETI. This search is motivated by the Earth’s suitability for 
transmitting and receiving radio signals at a specified range of frequencies commonly known 
as ‘the terrestrial microwave window’ (see Colloquy 4, in Morrison et al., 1977), as well as the 
ability for radio waves to travel interstellar distances without suffering significant absorption. 

Similarly, optical SETI searches (Schwartz and Townes, 1961) have been attempted to 
detect pulsed, narrowband, collimated optical light from stars. ‘Artefact SETI searches for 
other signs of technology, including waste heat (Dyson, 1960) or Solar System probes. The 
interested reader can find historical lists of radio and optical SETI searches in Ekers (2002). 
Both fields continue to advance: examples of the latest searches in both radio and optical 
are recorded in Isaacson et al. (2017), Tellis and Marcy (2017). 

Both radio and optical SETI have been boosted by an improved understanding of planetary 
systems around other stars (Wright, 2017). Indeed, the science of exoplanet detection has 
begun to yield new observables for SETI science, such as the possibility of detecting megastruc- 
tures in exoplanet transit light curves (Forgan, 2013; Korpela et al., 2015; Wright et al., 2015). 

As electronic costs have fallen, and the number of available sites for SETI observations has 
increased, the SETI community continues to grow throughout the world. Astronomers 
increasingly observe via large surveys (which produce large quantities of time series data at 
high sensitivity and cadence). This gives rise to the prospect for SETI via data mining of public 
archives, opening up the search to effectively the entire planet. 

Regardless of the detection method, the characterization of a SETI signal has several differ- 
ent phases. During each phase, the likelihood of such a signal being bona fide ETI increases or 
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decreases. In every signal to date, the likelihood has decreased to 
low enough values that there are no widely agreed ETI candidates 
at the time of writing. 

Almar and Tarter (2000) attempted to encapsulate the signifi- 
cance of a possible SETI signal using a simple linear scale. This 
was named the Rio scale, as it was first presented at the 51st 
International Astronautical Congress in Rio de Janeiro (see also 
Almar 2001, 2011; Almar and Tarter 2011). Broadly, this tool 
was designed for communicating with the public as to ‘how 
excited’ they should be regarding a signal. The scale is constructed 
by multiplying two numbers: Q, which describes the conse- 
quences of a signal if it is an ETI discovery, and 4, a description 
of the credibility of the signal being truly ETI. The resulting scale 


R= Qô. (1) 


Ranges between 0 and 10, with 10 being of the greatest possible 
excitement. 

In the 17 years since the scale was formulated, it has seen a 
modest level of traction in the press. Despite its simplicity and 
the availability of online calculators, in recent years, the scale 
has fallen out of use by SETI practitioners when evaluating 
their signals. As a result, the scale is not well known among sci- 
ence journalists, and by extension the wider public. 

The level of ‘brand recognition’ of Rio has been stymied to 
some degree by the general fragmentation of the media. The num- 
ber of news outlets has proliferated significantly, and stories now 
break and distort at alarming speed thanks to social media, which 
can hamper the efforts of scientists to communicate effectively 
with the public (Forgan and Scholz, 2016). The personal experi- 
ence of the authors suggests that the knowledge of the Rio scale 
among journalists is patchy at best, although Rio scale values 
have been reported for some recent claimed signals. 

The Rio scale should be assigned as a standard to any putative 
signal, and could be a valuable tool in managing public expecta- 
tions. However, the scale was formulated during a period when 
the scientists had the luxury of time in analysing the signal. It 
is increasingly common that signals become public knowledge 
without a great deal of analysis and checking, and the scale as 
it stands tends to over-rank signals compared with consensus 
opinion from the SETI community. 

We revisit the Rio scale, with the intent to 


(a) encourage all SETI groups to give every signal an R value, and 
to revise this value as further analysis is undertaken, 

(b) enhance the effectiveness of the scale in modern science com- 
munication and 

(c) to help calibrate public expectations of tentative signals. 


In the following sections, we recap the initial Rio scale (which we 
dub Rio 1.0/1.1) and then propose our replacement scale, Rio 2.0, 
which is calculated by completing a questionnaire. Finally, we dis- 
cuss how this scale should be used when communicating with the 
media and the general public about potential SETI signals. 


Terminology 


Before beginning, it is important to be clear on the use of jargon. 
A ‘detection’ has a clear astronomical meaning (in that a signal 
was received that exceeded some predefined noise threshold), 
but its meaning to the layperson has unwanted connotations of 
discovery and confirmation. 
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We advise the SETI community to adopt a single set of ter- 
minology for discussing signals. We will use the following phrase- 
ology to distinguish the various stages of a signal’s journey, from 
its initial registering on instrumentation to the final reduced data 
product (with accompanying physical interpretation). The vast 
majority of signals fail to proceed past the first or second steps. 
No current signal, not even the famous Wow! signal (see Gray 
and Ellingsen 2002 and references within), currently scores >1 
on either Rio 1.1 or Rio 2.0. 


e Speculative signals (S) are signals at their earliest stage. 
Speculative signals have only been analysed by one research 
group, on a single instrument. 

e Unverified signals (U) are signals whose data have been ana- 
lysed by more than one research group, ideally using different 
methods, but the signal has only been detected by one set of 
instrumentation’. 

e Verified signals (V) have been confirmed by at least one extra 
measurement with independent instrumentation. Verified sig- 
nals may still be due to instrumentation error. Depending on 
the signal and the equipment used, a non-instrumental origin 
can be demonstrated for some verified signals, and these pro- 
gress immediately into the next category. 

e Candidate signals (C) should only refer to a verified signal that 
is demonstrably not due to instrumentation effects. Candidates 
may have an as-yet-unidentified natural or anthropogenic ori- 
gin, such as radio frequency interference (RFI). Examples of 
candidates have included both pulsars and quasars in the 
immediate aftermath of their detection, before their natural 
causes were understood (see, e.g. Penny 2013). 

e Discovery (D) refers to a signal characterized as from ETI with 
high confidence. 


The Rio scale 1.0/1.1 


The initial Rio scale was defined as per equation (1), where R is 
the Rio score, Q represents the significance of the consequences 
of an event and 6 describes the probability that the event did 
indeed occur (and was not an instrumentation error, an interpret- 
ation error, a human-made signal or a deliberate hoax). 

Almár and Tarter (2000, 2011) describe Q as a sum of three 
factors, relating to the phenomenon class, the method of discov- 
ery and the distance of the event from the Earth (Table 1). Adding 
the three factors gives a value for Q between 3 and 15. Crucial fac- 
tors in the construction of Q include whether the signal is a mes- 
sage, containing information as opposed to a beacon, and whether 
the signal indicates the knowledge of the Earth’s existence (i.e. Is 
the signal specifically transmitted at the Earth or broadcast in all 
directions?). The nature of the observation —- either a deliberate 
search for SETI signals/evidence of artefacts (SETA) or an acci- 
dental or serendipitous observation - also influences Q, as does 
the apparent distance of the signal from the Earth. 

In the Rio 1.0 scheme, the 5 parameter was allowed to vary 
between 0 and 1, giving the range of R to be [0,15]. The later 
Rio 1.1 scheme (Almar, 2001) modified 5 so that R ranged 
between [0,10]. 

A calculator for Rio 1.1 is available online — the user interface 
is shown in Fig. 1. The calculator takes the form of a very simple 


'By definition (see later), both speculative and unverified signals will achieve negligible 
scores on the Rio scale. 
*http://avsport.org/|IAA/tiocalc.htm 
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Table 1. The schema for evaluating Q in the Rio 1.0 and 1.1 schemes 


Earth-specific message 6 

Omnidirectional message 5 SETI/SETA observation - steady 5 

Earth-specific beacon 4 Serendipitous observation - steady 4 In the Solar System 4 
Omnidirectional beacon 3 SETI/SETA observation - transient 3 Within 50 light-years 3 
Leakage radiation 2 Serendipitous observation - transient 2 In the Milky Way 2 
Traces of astroengineering 1 Archive data 1 Extragalactic 1 


artifact the purpose of which is understandable 
“Traces of astroengineering, or any indication of technological 
activity by an extant or extinct civilization at any distance, or an 


@bEarth-specific message, or an ET artifact, capable of contact, 
or a physical encounter 
Omnidirectional message with decipherable information, or a 
functioning ET artifact or space probe 
~Earth-specific beacon to draw our attention, or an ET artifact 
Select with a message to mankind 
Class of Omnidirectional beacon designed to draw attention, or an ET 
Phenomenon: | artifact with a message of a general character 
Leakage radiation, without possible interpretation, or an ET 
ET artifact, the purpose of which is unknown 


SETI/SETA observation; steady phenomenon verifiable by 


repeated observation or investigation 
Non-SETI/SETA observation; steady phenomenon verifiable 
Select by repeated observation or investigation 
Type of SETI/SETA observation; transient phenomenon that has been 
Discovery: verified but never repeated 
Non-SETI/SETA observation; transient phenomenon that is 
reliable but never repeated 


@©From archival data; a posteriori discovery without possiblity 


of verification 
Within the solar system 
Select Within a distance which allows communication (at lightspeed) 
Apparent | within a human lifetime 
Distance: | QWithin the Galaxy 
Extragalactic 
© Absolutely reliable, without any doubt 
Select Very probable, with verification already carried out 
Credibility Possible, but should be verified before taken seriously 
of Report: Very uncertain, but worthy of verification efforts 


Obviously fake or fraudulent 


Rio Scale Value 6 


mimoa: [E [Roine | 


Fig. 1. A screenshot of the Rio 1.1 calculator. The first three 
questions define Q, the significance of the consequences of 
a signal, and the last question estimates 6, the credibility of 
a claimed discovery. 


quiz, with three questions to determine Q using the schema in 
Table 1, and a single question to determine 5. While it is useful 
to have such a calculator for the public, it is extremely simple. 6 
can only take one of five values: (0, 0.2, 0.5, 0.7, 1.0). 
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It is also rather opaque to the user. The values of Q and 6 
are not displayed, only R. If the user reads Almar and Tarter 
(2000), they can deduce these values, but this takes a notably lar- 
ger effort. 
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Finally, this appears to be the only calculator available, and was 
designed well in advance of the Web 2.0. Web browsing is increas- 
ingly the domain of mobile devices, not desktop or laptop com- 
puters (Ofcom, 2015; Pew Research Center, 2015; GlobalStats 
StatCounter, 2016). Future Rio scale calculators should be flexible 
enough to be viewed on any Internet accessing system, and should 
respect accessibility standards - it is noteworthy that the current 
Rio 1.1 calculator respects HTML 4 and is accessible from current 
smartphone and tablet browsers. 

Rio 1.1 has helped us to clarify our thinking as to how to com- 
municate to the public regarding SETI signals. It has unfortu- 
nately only seen limited use by the SETI community when 
discussing its own signals, and it is not widely known among 
journalists or the general public. We feel that a revised Rio 
scale is necessary not only to improve the scale’s public profile, 
but to make it more relevant to modern communication practices 
and technology. This will in turn make it more appealing for both 
SETI practitioners and science communicators to use, as we 
describe in the following section. 


The Rio scale 2.0 
Desiderata for Rio 2.0 


In this section, we list some desired properties of the Rio scale, 
given its intended use as a tool to calibrate the public’s expecta- 
tions of the importance of an event. 


(i) The new Rio scale should not completely discard the struc- 
ture of Rio 1.0/1.1, ie. it should still be derived as R= Q 6, 
where Q is the consequence of the signal and 6 is the cred- 
ibility. However, there should be less focus on interpreting 
the signal, and more on its observational properties. 

(ii) We need to preserve the ability of Rio to deliver a score 
quickly. It should become a matter of course for SETI 
groups around the world to calculate a score in a few min- 
utes, and for groups to score each other’s work. 

(iii) The score needs to be as objective as possible — the subject- 
ivity of the user must not be allowed to dominate the final 
score. An ideal calculator would allow a roomful of people 
from various technical backgrounds to return similar scores. 
That being the case, if a SETI group announces a candidate 
with a high Rio score, and another gives a vastly different 
score (say a very low one), this remains valuable informa- 
tion for the public. 

(iv) Rio 2.0 should reflect our current estimations of signals 
(such as the Wow! signal, and Boyajian’s star). It should 
also reproduce previous estimations of old candidates 
such as quasars and pulsars. 

(v) The score should be easy to comprehend. A layperson 
should be able to answer the questions necessary to derive 
a score, as a means to understanding how signals are eval- 
uated (see vii). It is of course the case that expertize is 
needed to produce a sufficiently reliable score. 

(vi) The algorithm and code that implements the score should 
be open source for maximum transparency. Easily access- 
ible websites, webapps and smartphone apps should be 
developed so that anyone can derive a Rio score for a signal, 
given appropriate coaching. It is clear from citizen science 
projects that the general public are able to complete similar 
classification tasks with relatively low amounts of training. 
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(vii) Most importantly, the Rio scale should teach the public how 
SETI scientists evaluate signals. A well-designed website has 
the potential to be a powerful pedagogical tool, to inoculate 
against overblown press. It provides transparency to scien- 
tific thought processes, and indicates to the public how 
much work remains to be done to characterize the signal. 

(viii) Science communicators and other allied groups should be 
able to use it effectively when discussing the implications 
of a signal in social and digital media (Forgan and 
Scholz, 2016). 


Algorithm for the Rio 2.0 calculator 


We envisage the new Rio scale calculator as being a website host- 
ing a short quiz rather than a range of buttons on one page. Each 
page has a single question, and the user does not learn the values 
of Q or 6 until the quiz completes. In the case of 5, the quiz may 
complete early (e.g. if there is a good reason to believe the signal is 
a hoax). 

As with Rio 1.0, it is clear that the scale value will likely change 
with time (as other teams verify a signal, or as a plausible natural 
explanation is discovered). 


Questions to compute Q (0 to >10) 
(Q1) What is the estimated distance to the source of the signal? 
(Begin with Q between 0 and 4) 


Less than a light day (i.e. in the Solar System): Q = 4. 

Light-days to light-years (i.e. about as close as the nearest star): 
Q=3. 

Light-years to tens of light-years: Q = 2. 

Hundreds to thousands of light-years (in the Galaxy): Q=1. 

Longer/unknown: Q=0. 


(Q2) What are the prospects for communication with the source 
of the signal? (Add between 0 and 4 points to Q) 


We are in the active two-way communication: Q = Q + 4. 

We could respond using the same medium/encoding as the signal 
within 20 years: Q=Q+3. 

We can understand the signal or we have artefacts we can study: 
Q=Q+2. 


No communication is taking place: Q = Q + 0. 


(Q3) Is the sender aware of humanity/its technology? (Add 
between —1 and 2 points to Q) 


Yes, certainly - the signal is intended for us, specifically: Q = 
Q+2. 

Possibly, but there is a little or no evidence for this: Q= Q +1. 

Almost certainly not (e.g. they are too far away): Q= Q +0. 

Senders are apparently extinct: Q = Q-1. 


If Q<0: Q=0. 

Questions to compute 6 (0 to >1) 

Since any discovery of ETI is newsworthy, 5 maps well onto a 
scale of interest for the press, which we call J. 

J is computed as the product of three quantities: the probability 
that the signal is real (section A), the probability that it is not 
instrumental (section B) and the probability that it is not natural 
or human-made (section C). To preserve dynamic range at the 
bottom, the scale is expressed in terms of logarithms and rescaled 
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to have a maximum at 10: 
2log,)(8) + 10 =J=A+B+C-— 20, 


where J is the rescaled, logarithmic probability, and A, B and C 
represent the three logarithmic, rescaled probabilities that go 
into the final probability. 

The idea behind this rescaling is that two steps on the scale is a 
factor of 10. A value of 10 means 100% certainty, 8 means 10% 
confidence, 6 means 1% confidence and so on. 

J and 6 can be computed directly if probabilities for the three 
components can be assessed quantitatively. That is, if the prob- 
abilities to ‘yes/no’ answers to the questions to A, B and C can 
be determined, one multiplies them together to get 5 and calcu- 
lates J using the equation above. 

To assist with this assessment, one can construct a series of 
questions to guide the process of determining J, given below. 

Please note that this questionnaire is geared towards ‘everyday’ 
SETI ‘detections’, which means it is about splitting fine hairs for 
very low probabilities. As a result, this questionnaire does not pro- 
vide much granularity between 5 = 0.1—1. If a signal is confirmed 
to be artificial and extraterrestrial with 5>0.1, it may be necessary 
to revisit this calculation according to the specifics of that signal, 
while maintaining the spirit of the scale. 

Also note that the A, B, and C terms are not entirely independ- 
ent: the same fact can affect more than one term. Some facts also 
appear in Q. This is intentional and desirable: the nature of the 
signal, which contributes to Q, can also influence its credibility 
as being real, being astrophysical and being alien. 


Questionnaire for computing J 

Experts in a field relevant to a given ‘signal’ may use their judge- 
ment to give half points or otherwise interpolate for phenomena 
that land in between points on the scales below, or to adjust their 
points based on idiosyncrasies of a given signal that were 
unanticipated by this questionnaire. Notes are given below the 
questions to help users with their interpretation. 

A ‘perfect’ score on the questionnaire yields A= 10, B= 10, 
C=10, giving J=A + B+ C—20 = 10, or a 100% probability that 
the signal is real and alien. For these purposes, it is useful to 
remember that one point is worth roughly a factor of 3 in confi- 
dence and two points is worth a factor of 10. 

On this form, these terms mean: 


Anthropogenic: Made by humans. Includes radiation from objects 
made by humans. 

Artificial: Engineered by intelligent beings. 

Extraterrestrial: Originating outside the Earth. Can but does not 
definitively imply origin outside the Solar System. 

Instrumental: A product of a measurement instrument itself or its 
operator, as opposed to something natural or artificial. 

Natural: Not made by intelligent beings (i.e. the opposite of 
artificial). 

Terrestrial: Originating from the Earth. Not necessarily artificial. 
Includes objects that have left the earth - for example, under 
this definition Voyager 1 and 2 are still terrestrial. 


Section A: How real and amenable to study is the 
phenomenon? 


(A1) Is there a significant uncertainty about whether the phenom- 
enon occurred/occurs at all? For instance, are the data corrupted, 
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is there a significant risk of misunderstanding or transcription 
error? ‘Significant’ here means more than 10%. 


Yes, there is a significant uncertainty: A =6 (skip rest of A, go 
to B1). 
No, something almost certainly happened: A =7. 


(Examples of significant uncertainty: reports of sighting of a UFO 
or aliens, interpretation of ancient art, telescopic data from ama- 
teurs, interpreting other people’s data with little or no documenta- 
tion or metadata.) 

(A2) How amenable to study is the phenomenon? Award 
between 0 and 3 points based upon the repeatability of the 
phenomena. 


x=0: The phenomena has been observed exactly once (e.g. the 
Wow! signal). 

x=1: The phenomenon has been observed a small but plural 
number times, either as multiple targets showing similar phe- 
nomena, or a single target showing multiple similar events 
(e.g. claimed laser pulses in SDSS data (Borra and Trottier, 
2016), discovery of a few Fast Radio Bursts (FRBs) at a single 
observatory (cf. Lorimer et al., 2007)). 

x=2: The phenomenon has been confirmed to be real and 
repeated, for instance by multiple groups using a single instru- 
ment to observe the phenomenon or by an additional observa- 
tion with a different instrument or from a different site (e.g. 
FRBs discovered at other observatories, or once several FRBs 
were known). 

x =3: The phenomenon is observed routinely by different groups 
using different equipment (e.g. FRBs as observed today, see 
Petroff et al., 2016). 

A=A+x. 


(A3) Is the discoverer of the phenomenon the same person/group 
that predicted that such a phenomenon would indicate the pres- 
ence of alien intelligence? 


The claimants predicted the phenomenon they have ‘discovered’: 
A=A-1. 

The claimants have identified a new phenomenon, or one pre- 
dicted by others: A = A +0. 


People are natural wishful thinkers, and often see what they want 
to see, so it gives extra credibility to a claim if the groups doing the 
prediction and those doing the discovery are not the same. 


Section B: How certain are we that the phenomenon is not 
instrumental? 


(B1) Does the phenomenon look like a known instrumental or 
psychological effect? 


Yes: B=0, go to Cl. 
No: B=7. 


Examples of known instrumental effects: DC channel in a filter- 
bank file, cosmic rays in spectra, lens flare in photograph, known 
source of noise/bad data. 

Examples of known psychological effects: Reports of alien abduc- 
tion, UFO sightings; subjective, qualitative interpretations of 
apparent correlations in noisy data. 
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(B2) What chances do the instrument builders/experts in the 
method/observers of the phenomenon give that the signal is not 
instrumental? 

Award between 0 and 3 points: 


x=0: These experts have not weighed in at all. 

x=1: These experts give a ~90% chance that it is instrumental 
(so a ~10% it is real). 

x =2: These experts give even odds that it is instrumental. 

x= 3: These experts give <10% chance that it is instrumental. 


B=B+x. 


Section C: How certain are we that the phenomenon is not 
natural or anthropogenic? 


(C1) Is there a good reason to think the phenomenon is a hoax? 


Yes: C=0 —> J=0, end quiz. 
No: C=1. 


(C2) How does a wide community of experts assess the probabil- 
ity that there are any known sources of natural or anthropogenic 
signal that could explain the phenomenon? 


x=0: A wide range of experts agree that the signal is clearly nat- 
ural/anthropogenic, or said experts have not been consulted. 

x=1: It is consistent with a common phenomenon. 

x=3: It is consistent only with a rare or poorly understood 
phenomena. 

x=6: It is not consistent with any known natural or anthropo- 
genic phenomena (but unknown natural/anthropogenic phe- 
nomena could still be the cause). 

x=8: Only extraterrestrial, artificial explanations make sense 
(ie. those requiring non-human design and engineering, for 
instance: a Dyson sphere, a narrow band carrier wave from an 
extraterrestrial source, a strictly periodic pulsed laser; in other 
words: all natural and anthropogenic explanations been ruled out). 

x=9: The phenomenon contains information content of clearly 
intelligent design (i.e. it contains a message; or is an obviously 
artificial and alien artefact available for close - perhaps robotic 
— inspection). 


C=C+x. 

Examples of anthropogenic signals: terrestrial RFI for radio 
observations, terrestrial laser communications, experimental air- 
craft for well-documented UFO sightings. 


Computing J 


Now, calculate: 


J=A+B+C-20. 
ö = 10002, 


Interpreting Rio scores 


Interpreting Q 
If the signal is truly due to aliens, then the following scheme illus- 
trates the consequence of the discovery: 


Q=10: Revolutionary. Everyday life on the Earth will change 
forever. 
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Q=8-9: The making of an epoch; the future direction of human- 
ity is changed. 

Q=6-7: SETI becomes the ‘study of ETP. There are good pro- 
spects for near-future, limited understanding of ETI. 

Q=4-5: Scientifically revolutionary, but of no everyday conse- 
quence. Prospects for understanding ETIs remain decades in 
the future. 

Q=0-3: Philosophically ground-breaking, but of limited immedi- 
ate social or scientific impact. The prospects for understanding 
ETIs remain unclear. 


Interpreting J 

The value of J gives reporters a scale on which to compare previ- 
ous claims of signals or detections to new ones with enough 
dynamic range to distinguish, say, the Wow! signal, the SDSS 
lasers, sincere UFO claims and outright hoaxes. The scale is: 


J <1: No interest warranted. 

J=1-4: SETI interest potentially warranted; no press interest 
warranted. 

J = 5-6: SETI interest probably warranted; technical popular press 
interest potentially warranted. 

J=7-8: SETI interest definitely warranted; technical popular 
press interest probably warranted; possible off-beat news item 
for general press, if expressed with appropriate caveats. If not 
aliens, still very interesting. 

J=9: Significant mainstream press interest warranted, heavy 
coverage by technical popular press. Broad agreement that 
the signal could be due to aliens. 

J=10: Aliens. Front page of every major newspaper. 


Interpreting R 
We retain the description of R from Rio 1.1: 


10: Extraordinary. 
: Outstanding. 
: Far-reaching. 
: High. 

: Noteworthy. 
: Intermediate. 
: Moderate. 

: Minor. 

: Low. 

: Insignificant. 
: Nil. 
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Distribution of scores 


It is instructive to consider the range of possible scores produced 
by the new calculator, as was done by Almar and Tarter (2000, 
2011) for Rio 1.0/1.1. Figure 2 shows the distribution of possible 
Q values in the Rio 2.0 scheme. Q delivers values in the range 
0-10, with 5 being the median value (the mean is 4.76). Rather 
than the symmetric Gaussian distribution of Q seen for Rio 
1.0/1.1, Q is slightly skewed towards lower values. 

Almár and Tarter (2000, 2011) did not calculate a 6 distribu- 
tion, although it seems immediately clear that the new distribu- 
tion is quite different (Figs. 3 and 4). The vast majority of 
answers to the J questionnaire yield J=0, with a sparse distribu- 
tion of scoring towards the maximum of 10. This is principally 
due to some of the ‘deal-breaker’ questions regarding instrumen- 
tal effects and hoaxes. Consequently, the distribution for ô also 
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Fig. 2. The distribution of all possible Q scores in the Rio 2.0 scheme. 
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Fig. 3. The distribution of J scores in the Rio 2.0 scheme. 
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Fig. 4. The distribution of 5 scores in the Rio 2.0 scheme. 
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Fig. 5. The distribution of Rio scores in the Rio 2.0 scheme. 


tends towards low values (with a median of 107” and mean of 
0.0016), as a result of the log-scaling of J, which discriminates 
finely among signals of low probability of being artificial. 

Figure 5 shows the resulting distribution of R, given all possible 
permutations of Q and ô. The credibility variable heavily weights 
the scale towards 0. Indeed, the median is around 5 x 10~° (the 
mean is approximately 0.007). 


Good practice for using Rio 2.0 
Using Rio 2.0 to evaluate signals 


We intend for Rio 2.0 to be applied by any scientist (and the pub- 
lic if it wishes) to any signal, either their own signal or that of 
another team. The Rio score of a signal should be updated as 
new information or analysis arrives. Ideally, when a team pub- 
lishes a Rio score, it should also publish the answers to its ques- 
tionnaire, provide a brief explanation as to what factors 
contributed to the signal receiving this score and invite the public 
to attempt their own Rio scores. 

We also advocate that all three parameters (Q, J, 5, R) be pub- 
lished. A signal with low Q but high 5 may not result in extremely 
high-impact political events, such as discussions of whether to 
transmit a response, or the sharing of knowledge from an extra- 
terrestrial culture. That does not mean it is not of high philosoph- 
ical and cultural interest. Any SETI signal with high è will mark a 
watershed between two scientific epochs, regardless of its Q. 

Broadly speaking, once a speculative signal is detected, there 
are two possible futures. In the first, the signal may progress up 
the sequence towards an unverified or verified signal and achieve 
a small non-zero Rio score. New information may then come to 
light that reduces ô, potentially even ruling out the signal as a 
SETI candidate, and the Rio score becomes either very low or 
zero. This in fact is the typical outcome of all past SETI signals, 
from pulsars to Boyajian’s star (Boyajian et al., 2016). 

If this occurs, it is important that the team that is analysing the 
signal make a clear announcement to the media (via various 
forms of communication), of their signal’s current status. 

What if a signal defies refutation and attains the status of ‘can- 
didate signal’? Multiple groups should continue to assign Rio 
scores as more data are collected. A large collection of Rio scores 
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gives the public a useful barometer for measuring the degree of 
consensus in the community’s opinion of a signal, especially if 
that opinion is deeply divided. 

The following principles should be adopted by SETI scientists 
using Rio: 


(i) Score a signal immediately. 
(ii) Score it repeatedly, as new data arrive. 
(iii) Have it scored independently, by experts not participating in 
the observations. 


Ideally, press releases announcing the signals of a possible alien 
origin will include: 


(i) The team’s Rio score. 
(ii) At least one Rio score from an independent team. 


We would encourage science journalists where possible to com- 
pute their own score based on the available data. When the public 
read an article about SETI signals, they should check whether a 
Rio score is computed and ascribe more credence to stories that 
have multiple Rio scores from inside and outside the collaboration 
responsible for the signal. We would also encourage the public 
where possible to compute their own scores, to learn about the 
verification process for SETI signals and to see how their scores 
align with others available for a given news item. 


Evaluating the effectiveness of Rio 2.0 


Despite our best efforts to build an objective Rio scale, it is clear 
that there will always remain a subjective element to any attempt 
to determine a SETI signal’s ‘significance’. 

In the past, Rio 1.1’s objectivity has been evaluated by consider- 
ing scores for fictional scenarios (Shostak and Almar, 2002). The 
authors validated Rio 2.0 in a similar fashion, computing (Q, J, 6, 
R) for several fictional signal scenarios, with the resulting scores 
in a relative good agreement. This of course is not particularly sur- 
prising, as the authors have all contributed to the scale’s production. 

The full calibration of Rio 2.0 represents a ‘chicken-and-egg’ prob- 
lem. To calibrate the scale, it must be widely used by the community 
to find the areas of subjectivity and disagreement. To be widely used, 
it must be reasonably calibrated. We therefore have decided to take an 
adaptive approach. We deliberately label this scale ‘Rio 2.0’, as we 
expect that the scale (and questionnaires to deliver values) will con- 
tinue to evolve as the science of SETI continues to evolve. 

Hence, we recommend that Rio 2.0 be revisited after an appro- 
priate time interval and a reasonable amount of use by all inter- 
ested parties. It should then be evaluated for: 


(a) Its level of use by SETI practitioners and the media. 
(b) Its ability to deliver an objective score for test examples. 


To achieve this, we recommend collecting test score data from 
users on a set of well-defined fictional examples, as well as survey 
data regarding the scale’s efficacy. For each fictional example, the 
distribution of scores for each parameter (Q, J, 5, R) should be 
interrogated, in particular the sample mean and standard devi- 
ation, as well as the general distribution shape. Combined with 
a qualitative analysis of reviews/comments from survey respon- 
dents, this should provide sufficient calibration data for the next- 
generation Rio scale. 
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Summary 


We have revisited the Rio scale, a numerical tool used by SETI 
scientists to inform the public of the level of attention or excite- 
ment a SETI signal merits. Since Rio was first established 17 
years ago, it has seen steady use by limited sections of the SETI 
community and has a respectable (if limited) media profile. 

The last 17 years have seen a significant increase in the num- 
ber of groups active in SETI, coupled with an explosion in the 
production of media for public consumption. Stories about 
SETI are eagerly converted into newspaper articles, blogs and vid- 
eos, in many notable cases without due diligence being paid to the 
credibility of the signal. 

Our revision of Rio (Rio 2.0) aims to quickly calibrate the pub- 
lic expectations of a reported signal and to educate them as to how 
SETI scientists evaluate a signal, from its initial detection through 
the various verification stages needed to determine if a signal is 
credibly from ETI. 

This article details questionnaires for the two parameters that 
construct the scale, Q and 8. We have also provided a consistent 
set of terminology for the SETI community to use when discuss- 
ing signals, so that the public understands clearly what has been 
observed, and what level of verification a signal has received. 

As the science of SETI evolves, we expect the make-up of the 
Rio scale to also evolve- we therefore recommend that the scale’s 
use and efficacy be reviewed on an ongoing basis to ensure that 
Rio remains a highly regarded objective, widely used tool for com- 
municating with the public regarding SETI signals. 

A browser-based version of the questionnaire is available at 
https://dh4gan.github.io/rioscale2, with the source code published 
on Github”. We have run every possible iteration of each ques- 
tionnaire and collated the results to determine the distribution 
of values for Q, ô and R. The majority of questionnaire responses 
rightly result in a score of R= 0, reminding us that extraordinary 
claims require extraordinary evidence. 
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